AO-A044  904 


UNCLASSIFIED 

I OF| 

AO 

A044904 


STANFORD  UNIV  CALIF  SYSTEMS  OPTIMIZATION  LAB  F/8  12/1 

A SUBSTITUTE  INVERSE  FOR  THE  BASIS  OF  A STAIRCASE  STRUCTURE  LIN~ETC(U) 
DEC  76  R D NOLLMER  N00014-75*C»066S 

S0L>76>31  NL 


10-77 


ADA044904 


A SUBSTITUTE  INVERSE  FOR  THE  BASIS  OF  A 
STAIRCASE  STRUCTURE  LINEAR  PROGRAM 


BY 

RICHARD  D.  WOLLMER 


A SUBSTITUTE  INVERSE  FOR  TOE  BASIS  OF  A 


STAIRCASE  STRUCTURE  LINEAR  PROGRAM  , 


I 


i 

i 

i 

SYSTEMS  OPTIMIZATION  lABORATORY  ] 

DEPART’MENT  OF  OPERATIONS  RESEARCH 

Stanford  University 
Stanford,  California  . 

. 7). . 


Research  and  reproduction  of  this  report  were  partially  supported  by 
the  Office  of  Naval  Research  Contract  N00014-75-C  National 

Science  Foundation  Grant  0CR75-04544 ; and  the  Ener*|^^R^earrh  and 
Development  Administration  Contract  EY-76-S-03-0326 . 


Reproduction  in  whole  or  in  part  is  permitted  for  any  purposes  of  the 
United  States  Government.  This  document  has  been  approved  for  public 
release  and  sale;  its  distribution  is  unlimited. 

!./  7 f - 


A 


A SUBSTITUTE  INVERSE  FOR  THE  BASTS  OF  A 


1 


STAIRCASE  ST  RFC  I JKE  HINEFTR  FRC'OR.-.N 

by 

Richard  D.  Wo  Timer 


1 . The  Staircase  Structure 

A staircase  structured  linear  proj^ram  is  of  t!ie  form: 
Find  > 0,  tnin  z such  that 


A^Xi  - 


CfXi  + CgX,  + . . . C^X^  r,  Z 


1 . 1 ; 

fl.t) 

(1 .1^1} 


where  A^.  is  raj_  by  B^,  is  f’^e,  c^,  is 

one  by  and  x^.  is  n^  by  one.  The  staircase  linear  program  is  repre- 

sented in  detached  coefficient  form  in  Table  1. 

The  first  rows  (equations)  will  be  called  period  1 rows 

(equations),  the  next  rows  (equations)  the  period  2 rows  '^equations;, 

etc.  Similarly,  the  first  n^^  columns  (variables)  will  be  called  the 
period  1 columns  (variables),  etc. 


2 . Representation  of  the  Basis  Inverse 


Consider  any  basis  of  the  program  ( 1 . 1 )- ( 1 .T+1 ) . Clearly  any  such 
basis  must  also  be  staircase  with 

t t 

S “*i  ^ ' t = 1,...,T  (2) 

i=l  i=l 

for  if  not  the  first  + , . . + m^  rows  would  be  dependent.  Of  course 
equality  holds  in  (2)  for  t = T.  Let 

i i 

^ = Z"i'E"i  (3) 

t=i  t=i 

Then  the  staircase  structure  basis  may  be  further  broken  down  to  the  form 
in  Table  2. 

Theorem  2.1.  Through  a suitable  rearrangement  of  the  basis,  B,  columns, 

B may  be  put  in  the  form  of  Table  2 such  that  the  submatrix  consisting 
of  the  first  m^  rows  of  columns  of  B is  nonsingular,  t = 1,...,T  . 

Proof:  Clearly  the  first  m^^  + m^  + ...  + columns  in  this  restric- 

tion of  B are  independent  for  if  not  B is  singular.  Similarly  any 
basis  for  the  first  m^^  + . . . + m^  rows  of  B must  consist  of  m^^  + . . . 4 m^ 
columns.  Consequently  there  is  a subset  of  the  columns  of  the  first 
mj^  4-  . . . 4-  rOj,  rows  of  B consisting  of  the  first  n^^  4-  ...  + columns 

and  ” ^t  1 next  m^  columns  that  are  independent.  Hence  the 

theorem  is  proven  as  one  may  rearrange  the  first  n^ 
the  next  n^  columns  for  t •-  2 , etc. 


columns  for  t --  1, 


We  will  assume  throughout  that  the  columns  of  B are  rearranged 


r 

I 

so  as  to  satisfy  the  conditions  of  Theorem  2.1.  Then  in  Theorem  2.2  it 
will  be  shown  that  through  a scries  of  elementary  operations  B may  be 
placed  in  the  form  of  Table  5. 

Theorem  2 .2 . The  staircase  structure  basis  may  be  reduced  to  the  form 
displayed  in  Table  3 with 


Kj  = a;; 

(Jula) 

s - '‘l»l 

(U.lb) 

(k.tc) 

*^t  “ *t-i 

t > 1 

(l4.ta) 

t > 1 

( li . tb  j 

in  fl.tb-c),  0 is  a column  of  a^  ^ zero 

vectors  and 

"0  = 

Proof ; By  Theorem  2.1,  ~ ^11  well  defined  and  multiplying  by 

yields  the  desired  form  for  the  first  m^  equations.  Suppose  the  theorem 

holds  for  equations  m^ , m^ , ...  , m^^  ^ , and  the  basis  B is  placed  in 

the  form  of  Table  3 these  equations.  Subtracting  X 1^  times 

the  k-1  period  rows  from  the  k period  rows  yields  [Bj^  1 2 " ^^^^k  1 1^ 

\-l  \ Vl’^k-1  • Theorem  2.1  the  first 

k 

m^  columns  of  the  above  coefficients  must  be  independent  and 

= [B^  1 ^ ~ ^k  1 l^^k  1 2^^kl^  ^ exists  and  clearly  the  theorem 
holds  for  t = l,...,k  . The  theorem  then  follows  from  induction. 


From  this,  may  be  found  as  follows 


2 “ ^'p  ^'p 


I^T-2  2 ^T-1  “ '’t-1  ■ '^T-1  2 ^-1  2 '^T-l 


(5-T) 

(5.T-1) 


f^l2  ^2  J = ^2  ■ ^22^22  = ^^2 


[xiii  = 


(5.2) 

(5.1) 


Note  that  in  this  form  a period  t variable  may  be  basic  for 
period  t or  for  period  t+1  only. 

ng  the  Substitute  Inverse 

Suppose  a new  variable  is  to  enter  the  basis.  Let  t be  the  period 
of  the  entering  variable  and  k the  period  of  the  exiting  variable.  Then 
there  are  three  cases  to  consider:  k = t,  k > t,  or  k < t . Call  x^ . 

tj 

the  entering  variable  and  x^^^  the  exiting  variable. 

Case  1.  k = t.  There  are  two  subcases  to  consider;  the  exiting  variable 
x^^  is  basic  for  period  t or  the  exiting  variable  is  basic  for  period 
t+1.  In  either  situation,  none  of  a^,...,a^  will  change  according 
to  (5).  Also  ^ will  not  change.  Two  methods  for  updating 

K^,...,Kp  will  be  presented. 


Pivoting  Method.  To  form  the  new  K^.  if  the  exiting  variable  is 
basic  for  period  t , one  simply  multiplies  the  period  t coefficient 
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vector  of  by  the  current  append  it  to  and  pivot  on  the 

element  in  that  column  belonging  to  the  row  for  which  the  exiting  variable 

is  basic.  Then  for  s = t+l,...,T  are  found  recursively  as  follows. 

Compute  the  new  A , „ = K ,A  , . Consider  the  following  matrix 

s-1  2 s-1  s-1  2 ^ 


l^old|^old  _ ^new  ^ . Ak  J (6) 

s ' s S'l  2 ' s-1  1 s-1  2'  si'  s ' s ^ s-l  2'  s 1 ^ ' 


Clearly  the  last  m -a  , columns  form  the  last  m -a  , columns  of  the 
^ s s-1  s s-1 

identity  matrix.  Hence  the  new  is  obtained  from  the  old  one  by 

appending  to  it  the  matrix  2’  the  first  a^  ^ rows 

of  the  appended  columns,  and  then  dropping  them. 

For  the  situation  where  the  exiting  variable  is  basic  for  period 
t+1,  Kj.  will  remain  unchanged.  However,  A^^  and  will  change 

with  column  x^^  replacing  column  x^^^  = ’^ti  ‘ ^t+l'''’^^t 

obtained  as  in  the  previous  situation  with  the  new  being  obtained 

from  the  old  one  by  a single  pivot  and  the  new  obtained  from  the  old 

by  a^  pivots  for  s=t+2,...,T. 


* 

Dyad  Matrix  Method.  If  B is  an  m by  m non-singular  matrix, 

C is  an  m by  1 column  vector,  and  R a 1 by  m row  vector,  then 

(B  + CR]‘^  = [B"^  + kCR]  (7.1) 


This  approach  was  suggested  to  the  author  by  George  B.  Dantzig. 


8 


where 

C 

R - Rb" 

k 

1 + 

The  reader  may  verify  the  above  by  multiplying  BfCR  by  the  right  hand 
side  of  (7.1).  The  matrix  CR,  which  is  the  product  of  a column  and  a 
row  vector,  is  called  a dyad  matrix.  Hence  if  one  adds  a dyad  matrix 
to  B,  the  inverse  of  the  resulting  matrix  is  obtained  by  adding  a dyad 
matrix  to  B ^ . 

From  (7)  it  follows  recursively  that  if  R.  and  C.  are  column 
vectors  then 


its  inverse.  Note  that  it  follows  from  induction  in  the  above  that  each 
of  the  is  the  product  of  a row  vector  and  B Note  also  that  this 

representation  is  not  unique  and  in  fact  in  (8)  depends  on  the  ordering 
of  the  dyad  matrices. 


Performing  a pivot  operation  is  equivalent  to  adding  a dyad  matrix. 


Specifically,  R is  the  pivot  row  and  C is  such  that  its  i 


.th 


component 


is  the  multiple  of  R to  be  added  to  row  i.  Also  replacing  column 
by  Pj  in  a matrix  is  equivalent  to  adding  a dyad  matrix  with  C = 
and  R is  the  unit  vector  with  a one  in  position  j . 


Theorem  5.1.  Suppose  K 


new 


s 


old 


EC.R.K  where  C.  anr'  R.  are 
1 1 s 1 1 

1 

column  and  row  vectors  respectively.  If  ^ 


unchanged  then  C,'  R.'  where  C.'  and  R' 

s+1  s+1  Z-«  1 1 s+1  1 i 

and  row  vectors  respectively. 


arc  column 


Proof:  It  follows  from  (li.tc)  that  A^^'^  = + y^C^. R^.K°^^A 


s2 
new,-l 


s2 
old  -1 


1 I 


s s2 


and 


consequently  from  (U.ta)  that  “ ^^s  + 1^  ^53  ^i  ^i 


old 


R.  = R.  K A „ and  C,  - -[OIb  i]C..  The  theorem  follows  from  (8). 
xiss2  i^'sl-’i 


new 


CRK®^*^,  and  [0|B^^”]  = [01b°J'*]  + C'R 


Theorem  ^>.2.  Suppose  K 

old  old 

where  K'  = K +y'  C.  R.  K ;C,  C.  and  C are  column  vectors,  R, 

s ^ L 1 s ' 1 ’ i 

are  row  vectors  anS  R is  a unit  row  vector.  Suppose  also  B^^  and  A 

H 

are  unchanged.  Then  C.  R.  where  the  C.  are 

° s + 1 s+1  ^11  s+1  1 

i-1 

column  vectors  and  the  R^  are  row  vectors  . 


s+11 
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new, - 1 


iK-jr' 


Proof:  Fron  ^.N.ta)  and  it  follows  that  [K  ,1 

[-m^glO]  whore  M _ [[0;b“|'^]  * C R]  [K ’4CRK°^‘^  j - [0| 
or  M 4 CRJIK’-K^^^^]  4 [C '4  [0|  4 C 'RCIRk”^^^  . 

Thus  M and  consequently  ^ dyad  matrices.  The 

theorem  follows  from  repeat»>d  application  or  (7*1)  and  (7o)- 


Now  consider  what  happens  when  the  entering  and  exiting  basis 

variables  are  both  from  period  t . If  they  are  basic  for  period  t4 1 

then  K, , . . . ,K^  are  unchanged  and  is  obtained  from  by 

1’  ■’  t t4-l  t + 1 ^ 

a single  pivot  operation  which  is  equivalent  to  adding  a dyad  matrix. 

From  Theorem  3.I  it  follows  that  is  obtained  from  by 

s s 

adding  a single  dyad  matrix  whose  rows  arc  linear  combinations  of  the 

^ old  ..  ^ . 

rows  of  K for  s > t4-l. 

s 

If  the  entering  and  exiting  variable  are  basic  for  period  t, 
then  ^ are  unchanged  and  is  updated  by  adding  a single 

dyad  matrix  whose  rows  are  linear  combinations  of  the  rows  of  for 

s > t.  For  s - t4-l,  this  follows  from  Theorem  3.2  and  for  s > t4l 
this  follows  from  Theorem  J.l. 


Case  2 . k > t.  For  this  case,  each  of  a^,...,aj^  increase  by  one 

while  all  other  a.  remain  unchanged  according  to  (3).  Suppose  x^^ 

is  basic  for  period  k.  Let  x^.^  be  basic  for  period  t+1.  Then  a 

variable  x._  , > currently  basic  for  period  t+1  must  become 

t+1  j't+1)  ^ 

basic  for  period  t+2  instead,  and  continue  in  this  manner  until 

finally  a variable  x,  , . , basic  for  period  k-1  becomes  basic 

^ k-1  j,,k-l;  ^ 

for  period  k replacing  the  exiting  variable  x^j . If  is  basic 
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for  period  k+1  the  replacement  process  continues  for  one  more  period. 
For  this  case  are  unchanged. 


Pivoting  Method.  For  consider  (6)  for  s ---  t+1  and  where 

Bj.2  is  appended  by  one  column  whose  coefficients  are  generated  by  the 

coefficients  of  the  entering  variable  . Pivot  on  any  nonzero  element 

of  column  in  a position  3^.+!  or  higher.  (There  must  be  at  least 

one  such  element  or  Theorem  2.1  is  contradicted.)  Let  I be  the  pivot  row. 
th 

Then  the  I column  of  the  old  period  t+1  basis  (which  must  be  a column 
of  is  deleted  from  the  period  t+1  basis  and  introduced  in  the 

period  t+2  basis.  The  process  continues  for  Thus  for 

K , t+2  < s < k-1,  A is  appended  by  the  column  deleted  from  A , , • 

Then  K is  obtained  by  pivoting  on  the  first  a , + 1 rows  of  the  m 
by  a i + 1 (i-®->  a . is  increased  by  one)  matrix  The 

S“X  S**!  SS"Xt 

variable  deleted  from  the  period  s basis  is  the  one  which  has  a one  in 

the  same  position  as  that  of  the  column  Introduced  in  the  period  s basis. 

That  variable  is  then  introduced  into  the  period  s+1  basis.  For  s = k 
the  procedure  is  the  same  except  the  variable  leaving  the  period  k basis 

must  be  x,  . and  it  of  course  is  not  introduced  into  any  other  basis. 

For  s = k+l,...^T  the  computation  of  is  identical  to  that  of  Case  1. 

If  Xj^j^  is  basic  for  period  k+1,  it  leaves  the  period  k+1  basis  instead 
of  the  period  k basis  and  the  procedure  is  the  same  except  for  minor 
changes  in  the  sequence  of  values  for  s . 


Dyad  Matrix  Method.  Here,  in  many  cases  the  A B and  A 
— ' ’ ^ s2’  s2  s+11 

will  not  always  remain  the  same.  However,  as  will  be  seen  later  on,  when 
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this  happens,  only  one  column  of  the  matrix  [B^  A chanp.es.  This 

can  occur  by  replacing  a column  of  B^^^  (ami  consequently  a column 
of  A } by  another  column  in  B ,,,  cieleting  a column  rrom  B ^ and 

S<^  Sc 

adding  a column  to  etc.  Such  an  operation  will  be  called  an 

elementary  column  replacement. 


new  ..old 


Theorem  Suppose  K K -'•V'  C.R.K  where  C,  and  R.  are 

^ S SC_/lis  1 1 

1 f f 1 

column  and  row  vectors  respectively.  Then  = K°  , C.'R.'K°  , 

S + 1 Sfl  ^ 11  s+1 

^^and  possibly  a permutation  of  the  columns)  if  obtained 

from  t®s2*^^s+l^  elementary  column  replacement  and  where 

and  R^  are  column  and  row  vectors  respectively. 


Proof:  Case  1:  a'^^Y  is  obtained  by  a single  column  replacement  in 

s-rl  J b e 

From  Theorem  3*1^  replacing  A^^  with  i®  equivalent  to  adding  I 

dyad  matrices  to  ^ in  (6).  Replacing  ^ 

single  column  replacement  adding  another  dyad  matrix  to  ^ 

H6W  ” 1 

obtain  theorem  follows  for  this  case.  Case  2:  A column 

of  (and  consequently  A^^)  is  replaced.  Replacing  with 

in  (1.5c)  and  (6)  again  adds  a dyad  matrices  to  Then  replacing 

S+  i. 

old  , TjOlci  .new  , „new  . . i ^ 

A ^ and  B with  A and  B ^ is  equivalent  to  a simple  column 

replacement  thus  adding  another  dyad  matrix  to  obtain 

theorem  follows  for  this  case.  Case  3:  A column  of  (and  A^^)  is 

dropped  and  an  additional  column  is  appended  to  This  is  equiva- 

lent to  replacing  the  out.  ’ing  column  of  B with  the  incoming  column 

Sc. 

of  A , , and  the  outgoing  column  of  A _ with  a column  of  zeros.  Hence 

s^  1 1 a a g2 
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this  case  follows  from  case  2.  Case  li  ; An  additional  column  of  B ^ 

s2 

(and  A g)  is  appended  and  a column  of  dropped.  Delete  the 

outgoing  column  of  append  it  to  append  a column 

of  zeros  to  A . This  reduces  case  )i  to  case  2 and  the  theorem  is 
s2 

proven . 


Suppose  Xj^  is  basic  for  period  k.  are  unchanged, 

is  updated  by  a single  pivot  operation  hence  adding  a single  dyad 
matrix.  Assume  ^ is  updated  by  adding  I dyad  matrices.  For 
s = t+2,...,k-l  a variable  basic  for  period  s-1  becomes  basic  for 
period  s and  a variable  basic  for  period  s becomes  basic  for  period 
s+1  thereby  shifting  a column  from  (and  A^  to  Bg_j^2 

(and  A ^ ) and  also  shifting  a column  of  B . (and  A ) to  B 
(and  ■^g2)*  updating  one  may  update  the  inverse  by  first 

adding  a column  to  Bg_]^2  ^s-12^  deleting  a column  from 

and  then  deleting  a column  of  and  replacing  it  with  zeros  in 

[0|Bs  By  Theorems  5. 2 and  3 -5  and  would  be  updated  by 

adding  f4 1 dyad  matrices.  Note  that  for  Theorem  3.2  to  apply  the 
dyad  matrix  corresponding  to  the  deletion  of  a column  of  A^  in 

must  be  acted  upon  first  (i.e.,  correspond  to  i=l  4n  (8)).  For 
s=k  the  same  result  holds  except  that  the  column  of  A^^  and  Bj^ 
dropped  is  that  of  the  exiting  variable  and  hence  is  not  shifted  to  the 
k+1  period  basis.  For  period  k+1,  the  column  of  B^^  corresponding 
to  the  exiting  variable  is  dropped  while  > ^k+11  ^k4ll 


1.’. 


unchanged,  resulting  in  one  additional  dyad  matrix  to  be  added.  Hence 


for  s=t+f,’ , . . . ,k  Kg  is  updated  by  adding  s-t  dyad  matrices  and  for 
s > kfl,  Kg  is  updated  by  adding  kl-t  dyad  matrices.  The  result 
for  s > k+2  follows  from  Theorem 

If  is  basic  for  period  k+1,  the  replacement  goes  on  for  an 

additional  period  but  the  formulas  remain  the  same. 
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Case  . k t.  For  this  case  a^,...,a^  ^ each  decrease  by  one  accord- 

ing to  (5).  Suppose  Xj^j^  is  basic  for  period  k (k+1).  Since 
leaves  the  period  k (k+1)  basis,  a period  k (k+1)  variable  in  the  period 
k+1  (k+2)  basis  must  leave  that  basis  and  enter  the  period  k ^^k+1)  basis. 
The  process  continues  until  finally  x^^  enters  the  period  t basis. 


Pivoting  Method.  Suppose  x^^^  is  basic  for  period  k.  Then 
Kj^,...,K^  are  unchanged.  The  choice  for  the  period  k variable  to 
enter  the  period  k basis  may  be  any  variable  such  that  K^  times  its 
period  k column  coefficients  yields  a nonzero  element  in  the  posi- 

tion. For  s = k+l,...,t-l,  Kg  is  computed  as  follows.  Form  (6)  and 
perform  a sequence  of  pivots  on  the  mg  by  j^-1  matrix  o 

obtain  K . Then  K fB  , „|A  .I  will  be  the  identity  matrix  with  one 
s ss-12'sl 

column  missing.  Append  A^^^  with  the  coefficients  of  any  period  s 
variable,  Xg^  currently  basic  for  period  s+1  such  that  Kg  times  its 
period  s column  coefficients  yield  a nonzero  element  in  the  row  for 
which  Kg  has  all  zeros,  and  pivot  on  that  element  in  Kg  times  its 
column  coefficients.  Now  Xg^  is  in  the  period  s basis  and  has  left 
the  period  s+1  basis.  For  period  t , simply  let  the  period  t coefficients 


of  X . replace  the  coefficients  of  the  period  t variable  wtiich  has 

left  the  period  t basis  and  pivot  on  the  by  a^  matrix 

^old-  obtain  the  new  . The  procedure  for  finding  , , . . . ,K^ 

t t-1  2 t ‘ ” t+1^  ’ T 

is  then  identical  to  that  of  Case  1. 

If  is  basic  for  period  k+ 1 instead  of  period  k the  pro- 
cedure is  the  same  except  that  is  unchanged  and  x^^^  leaves  the 

period  k+ 1 basis. 


Dyad  Matrix  Method.  Suppose  Xj^j  is  basic  for  period  k.  Then 

a column  of  and  is  shifted  to  and  to  replace  the 

column  coefficients  of  ^ single  pivot,  or  the  addition  of  a single 

dyad  matrix  then  updates  . For  s = k-fl,...,t-l  an  additional  column 

is  added  to  B and  a column  is  added  to  A ,,  and  B ,,  and 

s-11  s+11  s+11 

deleted  from  A _ and  B . Hence  as  in  case  2,  if  K , is 

s+12  s+12  ' s-1 

updated  by  adding  t dyad  matrices,  is  updated  by  adding  i+1  dyad 

matrices  by  Theorems  J .2  and  5-3*  The  same  is  true  for  s=t  except  that 

the  column  added  to  A , and  B , is  x . and  hence  no  column  is 

tl  tl  ti 

deleted  from  A^.,^  and  Hence  Kj^,...,K^  ^ are  unchanged.  is 

updated  by  adding  s-kt  1 dyad  matrices  for  s=k,...,t  and  by  adding 
t-k+2  dyad  matrices  for  s > t+1.  The  latter  follows  inductively  from 

Theorem  J.J  for  s=t-tl  and  Theorem  J.l  for  s > t+2 . 

If  X|^j  is  basic  for  periled  kil,  Kj  , . . . ,kj^  are  unchanged.  An 
argument  similar  to  the  above  shows  that  is  updated  by  adding  s-k 

dyad  matrices  for  s ktl,...,t  and  by  adding  t-k+1  dyad  matrices  for 


s > t+ 1 , 


1' 


1;. 


FlndinR  the  Multipliers 


In  Theorem  li . 1 it  will  be  shown  that  the  simplex  multipliers  may 
be  found  by  the  following  recursive  relationships; 


■^T  “ S-1  2 S 


(9.T) 


TT, 


t = Vl  2 "tl  - ^t+lt°l\l^^^  ^ < 


(9-t) 


where 


^11  = Sl^ 


(10.1) 


"t-1  2 ^tl  “ 2'  '•^t-2  2 ^t-1  l^^t-1  2l^t^'^t^  t > 1 (10. t) 


with  and  being  vacuous. 


Theorem  4.1.  The  simplex  multipliers  are  given  by  (9)- 


Proof:  From  Table  2,  + ^2®11  “ ^11  thus  from  (It. la) 

- ■^2^11^1'  theorem  holds  for  t = 1.  Suppose  the 

theorem  holds  for  t - k.  For  t = k+1  one  has  (i)  ^k+l^k2  ~ ^k2 

and  (ii)  tt,  ,A,  , , + tt,  „ B,  , , = C,  , ,,  using  the  convention  for 
' k+1  k+1  1 k+2  k+1  1 k+1  1 

k+1  = T that  = 0,  - | O]  and  = ‘^T ' inductive 


assumption  and  (Ike),  = [C^_^  ]\o  ‘ '^k+1  ®kl  ^^k2' 


T1  ■■  I ”T1  ”T‘ 

'k‘^k2  " ^^k-1  2 ^kl^^k2 
may  be  replaced  with  (iii)  2 Sl^^k2' 

Combining  t'ii)  and  (iii)  yields  [Bj^2  " ®kl  ^^k2^  ^k+1  1^  “ 

1‘^k;.  - 'S-l  2 'kl'VVl  l'  - V2'“i'‘k*l  l>- 


is  vacuous  yields 


both  sides  on  the  right  by  1C  and  noting  that  C 

K \ L 

(9-b)  for  t = k+1 . The  theorem  follows  from  induction. 

Once  the  simplex  multipliers  are  known,  one  can  find  the  new  variable 
to  enter  the  basis. 

5 • Finding  the  Exiting  Variable 

As  in  the  previous  section  let  be  the  entering  variable. 

Then  let  and  be  its  original  nonzero  coefficients  as  given  in 

Table  1 and  its  period  k coefficients  in  the  reduced  form  of 

Table  5-  From  ();)  it  follows  that 


\ = 0,  k < t 


a.  = K A 

t t t J 


\ = -\f°IVi  i^Vi  ^ 


(11) 


Letting  all  nonbasic  variables  other  than  be  zero  it  follows  from 

(5)  and  (11)  that 


k-1  2 ^kl 


b'  - a,’ 


k^ 


( 12  .ka ) 


where 


( 12  .Tb  ) 
(12. kb) 
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Hence  the  pivot  row  must  satisfy 


u 

ki 

■=-7—  - min 

a ' 

ki 

(13) 

ki  a ' >0 

ki 

■ 

ki 

where  b . and  a,' . 

ki  ki 

. . th 

represent  the  1 

components  of  bj^ 

and  a,* 
k 

respectively . 

6 . Concluding  Remarks  and  Example 

The  development  of  special  purpose  algorithms  to  take  advantage  of 
staircase  structures  in  linear  programs  has  previously  been  dealt  with 
by  Dantzig  [2],  Ho  and  Manne  [6],  Ho  [7],  and  Glassey  [5]. 

Dantzig  [2]  uses  a substitute  basis  as  opposed  to  a substitute 
inverse  for  solving  the  more  general  staircase  problem  in  which  nonzero 
elements  may  appear  anywhere  below  the  diagonal. 

In  the  decomposition  of  Ho  and  Manne  [6]  it  was  reported  that 
computer  storage  requirements  were  greatly  reduced  when  compared  to  the 
simplex  method  but  computation  times  were  significantly  increased. 

However,  Ho  [7]  has  subsequently  incorporated  new  techniques  which 
reduced  computation  times  below  that  of  the  simplex  method. 

Storage  requirements  of  the  method  of  this  report  should  be 
competitive  with  the  [6] . Computationally  more  frequent  but  faster 
matrix  reinversions  would  be  required  using  this  method  than  with  the 
simplex  method. 

If  pivoting  is  used,  then  computational  efficiency  depends  largely 
on  the  column  dimensions  of  the  a^  in  Table  The  simplex  method  using 
product  form  of  the  inverse  requires  multiplication  by  an  m by  m matrix 
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which  is  the  identity  except  for  one  colunm  in  order  to  update.  For  the 
substitute  inverse^  no  updating  occurs  for  periods  earlier  than  the 
periods  of  both  the  entering  and  exiting  variables.  To  update  one 

multiplies  by  an  by  matrix  which  is  identical  to  the  identity 
matrix  except  for  one  column  if  s is  the  first  period  to  be  updated 
and  multiplies  by  a ^ such  matrices  otherwise.  Hence  efficiency 
depends  to  a large  extent  on  the  a^ . Previous  experience  on  problems 
of  this  type  indicate  that  the  a^  are  usually  quite  small. 

If  the  dyad  matrix  method  is  used,  computational  efficiency 
depends  largely  on  the  absolute  difference  between  the  periods  of  the 
entering  and  exiting  variable.  In  particular  if  the  entering  and 
exiting  variable  are  of  the  same  period,  the  which  are  updated 

are  done  so  by  adding  one  dyad  matrix.  Otherwise  one  updates  by  adding 
anywhere  from  one  to  the  absolute  difference  between  the  periods  of  the 
entering  and  exiting  variables.  The  addition  of  a dyad  matrix  is  about 
the  equivalent  of  a single  pivot  in  terms  of  computation  time. 

Note  that  with  either  method  one  would  want  to  reinvert  more  often 
in  the  higher  numbered  periods  than  in  the  lower  numbered  ones.  If  all 
periods  had  the  same  number  of  equations,  one  could  reinvert  the 
matrices  approximately  T times  as  often  as  in  the  simplex  method  and 
still  be  competitive.  It  should  also  be  noted  that  the  number  of  dyad 
matrices  to  be  added  to  the  cannot  exceed  T at  any  iteration 

and  that  this  can  occur  only  in  period  T and  even  then  only  if  the 
pair  of  variables  entering  and  leaving  the  basis  are  from  periods  1 
and  T.  Hence  if  one  were  to  reinvert  after  a fixed  number,  say  k,  of 
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dyad  riUiLrix  additions  to  any  one  would  rcinvert  fewer  than  T 

times  as  often  as  one  would  by  reinverting  after  k iterations  of  the 
simplex  method.  Of  course,  using  this  criteria,  some  of  the  fin 

particular  ) would  be  updated  fewer  than  every  k iterations  and 
others  (in  particular  K.^)  would  be  updated  more  often  than  every  k 
iterations . 

The  relevant  parameters  discussed  above  were  gathered  from  a 

standard  simplex  method  run  of  the  9 period  PILOT  energy  model  and 

the  results  are  summarized  in  Table  1.  The  values  of  the  a are 

i 

large  enough  to  indicate  that  the  pivoting  method  would  not  be  effi- 
cient except  for  period  9 and  of  course  the  first  period  to  be  updated. 
However,  the  dyad  matrix  method  of  updating  appears  to  be  extremely 
efficient.  Noting  that  period  9 has  much  fewer  constraints  than 
periods  1 through  8,  the  dyad  matrix  update  method  should  be  compe- 
titive with  the  simplex  method  if  no  more  than  8 dyad  matrices  are 
added  per  period  per  iteration.  Table  4 shows  that  the  last  period, 
which  is  the  one  requiring  the  largest  number  of  dyad  matrix  addi- 
tions, requires  but  3. 218  per  iteration.  The  average  number  of  dyad 
matrix  additions  per  iteration  for  all  periods  is  I.778. 
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Period 
Number  (i) 

Number 

Constraints 

of 

Variable 

Average 

a . 

1 

Numb 

Matri 

Total 

er  of  Dyad  ^ 

X Additions 
Average  per 
Iteration 

1 

106 

31+5 

26 

17 

.137 

2 

1C7 

346 

57 

53 

.487 

5 

107 

3U6 

29 

106 

.895 

u 

107 

546 

31 

165 

1.331 

5 

107 

346 

28 

229 

1.847 

6 

107 

546 

29 

284 

2 .290 

7 

107 

346 

26 

339 

2.73^ 

8 

12  h 

363 

2 

380 

3.065 

9 

k6 

46 

-- 

399 

3.218 

TABLE  U;  Statistics  for  the  PILOT  energy  model  run  of  12h  iterations 


These  numbers  are  based  on  the  assumption  that  the  entering 
and  exiting  variables  are  basic  to  the  period  for  which  they  belong 
(except  for  the  entering  variable  in  Case  2 of  Section  3)-  The  fact 
that  this  would  not  always  be  the  case  means  actual  numbers  would  be 
lower  than  those  in  the  last  two  columns  of  Table  h . 
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TR  SOL  76-31:  "A  Substitute  Inverse  for  the  Basis  of  a Staircase  Structure 

Linear  Program",  by  Richard  D.  Wollmer 

This  report  concerns  a method  for  computing  a substitute  Inverse  for 

linear  programs  with  a staircase  structure.  The  constraints  of  a staircase 

structure  linear  program  are  of  the  following  form: 


A^  xi  = di  ; 

\-l  ^-1  ^ \ \ = ‘^t  • 


(t  = 2,  T) 


Letting  m^  be  the  number  of  constraints  in  period  i,  the  substitute  inverse 
consists  of  the  Inverse  of  T matrices  which  are  m^  x m^,  i = 1,  T as 

opposed  to  the  actual  inverse  which  is  m x m,  m = Z.  m^.  Hence  the  substitute 
inverse  would  require  significantly  less  storage  than  the  actual  inverse. 

Two  methods  are  presented  for  updating  the  substitute  inverse,  both  of 
which  consist  of  updating  some,  but  not  necessarily  all  of  the  T smaller 
inverses.  The  first,  a pivoting  method,  requires  appending  one  or  more 
columns  to  the  smaller  inverses  and  pivoting  on  the  appended  columns.  The 
second  requires  adding  one  to  T dyad  matrices  to  the  smaller  inverses. 
Computational  efficiency  of  both  methods  can  be  tested  to  a large  degree 
using  standard  linear  programming  codes. 
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